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ESTIMATION  OF  THE  OPERATING  CHARACTERISTICS  OF  ITEM  RESPONSE 
CATEGORIES  III:  NORMAL  APPROACH  METHOD  AND  PEARSON  SYSTEM 

METHOD 

ABSTRACT 

In  the  present  study,  two  new  variations  of  the  Conditional 
P.D.F.  Method  for  estimating  the  operating  characteristics  of 
item  response  categories  are  introduced.  They  are  called  the 
Normal  Approach  Method  and  the  Pearson  System  Method.  Just 
like  the  Two-Parameter  Beta  Method,  these  two  methods  are  charac- 
terized by  such  facts  that:  1)  no  prior  mathematical  models  are 
assumed  for  the  operating  characteristics;  2)  we  use  a relatively 
small  number  of  examinees  in  the  whole  process;  3)  the  joint 
distribution  of  the  latent  trait  0 and  its  maximum  likelihood  esti- 
mate is  fully  utilized,  and  A)  the  method  of  moments  is  effectively 
applied.  In  the  Normal  Approach  Method,  the  conditional  distri- 
bution of  0 , given  its  maximum  likelihood  estimate,  is  approx- 
imated by  a normal  distribution,  with  its  two  parameters  derived 
theoretically,  by  using  the  estimated  probability  density  fxjnctlon 
of  the  maximum  likelihood  estimate.  In  the  Pearson  System  Method, 
the  conditional  distribution  is  approximated  by  one  of  the  Pearson 
System  distributions,  depending  upon  the  value  of  the  criterion 
K computed  from  the  four  conditional  moments  of  6 , given  its 
maximum  likelihood  estimate.  The  same  simulated  data  for  500 
hypothetical  examinees  and  ten  binary  items  are  used,  as  in  the 
Two-Parameter  Beta  Method.  The  results  are  compared  with  those 
obtained  by  the  TWo-Parameter  Beta  Method. 


The  research  was  conducted  at  the  principal  Investigator's  laboratory, 
409  Austin  Peay  Hall,  Department  of  Psychology,  University  of  Tennessee, 
Knoxville,  Tennessee.  The  group  of  graduate  assistants  was  headed  by 
Robert  L.  Trestman.  The  computer  programming  work  was  greatly  assisted 
by  one  of  the  graduate  assistants,  Yeh  Chlng-Chuan,  and  some  by  the 
undergraduate  assistant,  Philip  S.  Livingston.  The  other  assistants 
working  for  her  at  various  times  Include  C.  I.  Bonnie  Chen  and  1,1-Jen 
Jenny  Chen. 


II 

Normal  Approach  Method 

3 

III 

Results 

6 

IV 

Pearson  System  Method 

24 

V 

Results 

27 

VI 

Comparison  of  the  Approximated  Density 
Functions 

49 

1 


References 

61 

Appendices 

Appendix  I 

63 

Appendix  II 

67 

Appendix  III 

95 

1 Introduction 


In  estimating  the  operating  characteristics  of  item  response 
categories,  such  new  methods  as  the  Normal  Approximation  Method  and 
the  Two-Parameter  Beta  Method  and  its  variations  have  been  developed 
and  tested  (Samejima,  1977b,  1977d,  1978).  In  the  present  study, 
two  more  methods,  the  Normal  Approach  Method  and  the  Pearson  System 
Method,'  are  presented  and  tried  on  a set  of  simulated  data,  and  the 
results  are  compared  with  those  of  the  previous  studies. 

Data  used  in  this  research  are  the  same  simulation  data  adopted 
in  the  previous  studies,  and  are  summarized  as  follows. 

(1)  The  number  of  hypothetical  examinees  is  five  hundred. 

(2)  Their  ability  levels: 

Each  subgroup  of  five  examinees  are  located  at  each  ability 

level  of  -2.475,  -2.425,  -2.375,  -2.325 etc.,  up  to 

2.475  with  the  step  of  0.05  . 

(3)  The  Old  Test: 

This  is  a set  of  thirty  five  graded  test  items,  each  having 
four  item  score  categories,  which  provides  us  with  an  approxim- 
ately constant  test  information  function,  21.63,  for  the 
interval  of  ability,  [-3.0,  3.0],  following  the  normal  ogive 
model  on  the  graded  response  level  (Samejima,  1969,  1972). 

(4)  The  examinees'  ability  estimates: 

For  each  examinee,  a response  pattern  on  the  old  set  of 
test  items,  or  the  Old  Test,  has  been  calibrated  by  the  Monte 
Carlo  method,  and  the  maximum  likelihood  estimate  has  been 
obtained  on  this  response  pattern. 
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(5)  The  new  set  of  binary  test  items: 

This  is  a new  set  of  ten  binary  items,  or  the  New  Test, 
each  of  which  follows  the  normal  ogive  model.  Each  examinee's 
response  pattern  on  this  new  set  of  test  items  has  been 
calibrated  by  the  Monte  Carlo  method. 

The  common  procedure  is  to  estimate  the  item  characteristic  function, 
l.e.,  the  operating  characteristic  of  the  item  score  1 , of  each  of  the 
ten  binary  items,  without  assuming  any  prior  mathematical  model.  Once 
it  has  been  accomplished,  however,  the  two  parameters  in  the  normal 
ogive  model  on  the  dichotomous  response  level,  i.ei,  the  discrimination 
and  difficulty  parameters,  are  estimated  by  a simple  least  square  method, 
as  an  additional  Information. 

The  asymptotic  property  of  the  maximum  likelihood  estimate,  l.e., 
the  normality  of  its  conditional  distribution,  given  ability  6 , with 
0 itself  and  the  inverse  of  the  test  Information  function  1(6)  as 
the  two  parameters  (cf.  Samejlma,  1975,  1977a,  1977b),  is  fully  utilized. 
In  the  Two-Parameter  Beta  Method,  g(0)  , the  probability  density  function 
of  the  maximum  likelihood  estimate  § , is  approximated  by  a polynomial  of 
degree  3 or  A by  the  method  of  moments  (Elderton  and  Johnson,  1969; 

Johnson  and  Kotz,  1970),  and  two  cases.  Degree  3 and  A Cases,  are 
distinguished  from  each  other,  depending  upon  which  degree  is  used  for 
the  polynomial.  We  will  deal  with  these  two  cases  in  the  present 


study  also. 
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II  Normal  Approach  Method 

0 

The  Conditional  P.D.F.  Method  has  been  Introduced  as  a variation 
of  the  1>rfo-Pararaeter  Beta  Method  (Samejlma,  1978).  Let  4)(O|0)  be 
the  conditional  density  function  of  ability  0 , given  its  maximum 

iiS 

likelihood  estimate  0 . We  can  write 


(2.1)  4'(o|0)  - 4'(e|o)  f(e)  I [ ii-(o|o)  f(0)  dO] 


- i|.(0|e)  f(0)  ig(0)i 


-1 


where  l)'(0|0)  is  the  conditional  density  function  of  6 , given  0 , 
which  is  approximated  by  n(0,O*)  , f (0)  is  the  probability  density 

A 

function  of  ability  0 , and  g(0)  is  the  probability  density  function 
of  the  maximum  likelihood  estimate  P . For  the  present  set  of  data, 
or  the  Old  Test,  " (21. b3)  ^ - O.OAb  , and  f (0)  ■ 0.2  . This 
function,  (j'(0|P)  , is  not  observable  in  the  empirical  slttintion. 

By  virtue  of  the  uniform  test  information  function,  however,  we  have 
the  following  relationships  for  the  conditional  expectation  and 
variance  of  0 , given  0 . 


(2.2) 

(2.3) 


E(0|6)  - 6 + log  g(§)  - § + 8(6)Hg(8))~^  . 

Var.(0)6)  » o^^Il  i-  o'“^-jlog  g(P)l 

' o'l\  + oM  ^‘‘^^g((^)-g(6)  - I g(P))M{g(e))‘^] 


Using  these  two  conditional  moments,  in  the  Two-Parameter  Beta  Method, 
with  g(9)  approximated  by  a polynomial  of  degree  3 or  4,  4'(0|^)  Is 

approximated  by  a Beta  density  function  with  a priori  set  two  parameters. 
Tlien  the  estimated  item  characterist  ic  function  is  given  by 


! 

i 


(2.4)  P (6)  - I $(e|9j[  E $(e|0  )) 

* seG  s-1 

where  s Is  an  Individual  examinee,  N (~  500)  is  the  total  number 
of  examinees,  G is  the  group  of  examinees  who  answered  item  g 
correctly,  or  the  "success"  group,  and  4>(6|6^)  is  the  estimated 
conditional  density  function  of  0 , given  the  maximum  likelihood 
estimate  of  the  individual  s . 

In  the  present  study,  instead  of  using  a Beta  density  function, 
a normal  density  function  is  adopted  for  4)(0|0)  , and  used  in  (2.4) 
to  obtain  the  estimated  item  characteristic  function. 

The  estimated  probability  density  function  of  0 is  given 
by 

(2.5)  f(0)  - E $(0|§g)  , 

s*l 

as  an  additional  information.  The  simple  least  squares  method  (Samejlma, 
1977d,  1978)  is  used  for  estimating  the  discrimination  and  difficulty 
parameters  in  the  normal  ogive  model. 

When  4i(0|§^)  is  replaced  by  the  true  conditional  density, 
(}i(0|§^)^  in  (2.4),  the  resulting  function  is  called  the  criterion 
item  characteristic  function  (Samejlma,  1978).  This  function  is  used 
as  a criterion  in  evaluating  the  estimated  item  characteristic  fvinctions 
obtained  by  the  Conditional  P.D.F.  Method. 

The  Normal  Approach  Method  has  a convenient  property  of  requiring 

/N 

only  the  first  two  conditional  moments  of  0 , given  0 , just  like 
the  Two-Parameter  Beta  Method.  Since  the  estimation  of  the  moments 


of  higher  order  tends  to  be  more  inaccurate,  it  is  desirable  to  use  a 
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fewer  number  of  conditional  moments.  In  so  doing,  however,  the  variety 
of  the  shapes  of  the  density  function  will  be  restricted  by  the  use  of 
too  few  conditional  moments,  and  the  estimation  of  the  operating  charac- 
teristics will  become  inaccurate.  How  to  counterbalance  these  two 
opposing  factors  and  produce  optimal  results  is  the  crucial  point, 
and  is  the  focus  of  the  researcher's  effort. 

In  the  Normal  Approach  Method,  we  have  for  the  conditional 
density  of  0 , given  6 , 

(2.6)  $(016)  - [2TT]'^^^exp[-{e  - E(0|0)}2/{2Var.(0|0)}]  , 

where  E(0|0)  and  Var.(0|0)  are  given  by  (2.2)  and  (2.3)  respectively. 
Since  this  function  is  always  unimodal  and  symmetric,  it  is  conceivable 
that  the  approximation  of  ({i(0|0)  by  (2.6)  will  cause  a substantial 
distortion  and  result  in  an  inaccurate  estimation  of  the  operating 
characteristics.  We  will  wait  and  see  the  result  to  reach  einy 
conclusion. 


Jii 
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III  Results 

As  was  mentioned  earlier  (Samejlma,  1977d),  the  maximum  likelihood 
estimate  for  the  examinee  No.  2 turned  out  to  be  -3.0555,  l.e.,  much 
lower  than  the  other  values.  Because  of  this,  this  examinee  has  to 
be  excluded  In  Degree  4 Case,  since  the  estimated  probability  density 
function  at  this  value  of  0 assumes  a negative  value,  although 
the  approximation  to  g(6)  by  the  polynomial  of  degree  3 provides 
a positive  density  at  this  point  of  0 . There  are  six  more  examinees 
whom  we  have  to  exclude  In  Degree  4 Case,  l.e..  Subjects  99,  101,  201 
296,  299  and  300,  since  the  estimated  conditional  variance  of  0 , given 
0 , turned  out  to  be  negative.  Thus  we  could  use  the  total  number 

of  500  examinees  In  Degree  3 Case,  and  493  examinees  In  Degree  4 Case, 
in  the  present  research.  We  actually  used  499  subjects  In  Degree  3 
Case  and  486  subjects  In  Degree  4 Case,  however,  excluding  one  subject  In 
Degree  3 Case,  and  seven  more  subjects  in  Degree  4 Case,  whose  fourth 
conditional  moments  turned  out  to  be  negative.  This  exclusion  reduces  the 
number  of  subjects  used  In  the  present  study  in  each  case,  but  makes  the 
comparison  with  the  results  of  the  Pearson  System  Method,  which  will 
be  introduced  in  the  following  section,  easier.  Thus  the  examinees 
excluded  in  the  present  study  are  Subject  2 (0  = -2.425)  In  Degree  3 
Case,  and  Subjects  1,  101,  201  and  401  (0  = -2.475),  Subject  2 , 

Subject  3 (0  = -2.375),  Subject  4 (0  = -2.325),  Subject  296  (0  » 2.275), 
Subject  98  (0  - 2.375),  Subjects  99,  199  and  299  (0.-  2.425),'  and  Subjects 
300  and  500  (0  “ 2.475),  In  Degree  4 Case. 

Figure  3-1  presents  the  estimated  item  characteristic  functions 
of  the  ten  binary  Items  In  both  Degree  3 and  4 Cases,  by  a broken  curve 
and  a dotted  curve  respectively,  along  with  the  criterion  item  character- 


Istlc  functions.  From  these  graphs,  It  is  very  clear  that,  in  both 
Degree  3 and  A Cases,  the  estimated  item  characteristic  function  In 
the  Normal  Approach  Method  is  practically  Identical  with  the  criterion 
item  characteristic  function  for  every  item  in  the  interval  of  6 
[-2.0,  2.0],  where  the  accuracy  of  estimation  is  Important.  This  means 
that  the  present  method  has  provided  us  with  practically  perfect  results 
within  the  limitation  of  the  Conditional  P.D.F.  Method,  as  far  as  the 
present  simulation  data  are  concerned. 

It  should  be  recalled  that  the  practically  same  results  were 
obtained  by  the  Conditional  P.D.F.  Method  of  the  Two-Parameter  Beta 
Method  (Samejlma,  1978),  in  both  Degree  3 and  4 Cases.  We  must  conclude, 
therefore,  that,  without  waiting  for  the  results  of  the  Pearson  System 
Method,  that  these  two  methods  have  produced  most  successful  results 
that  the  Conditional  P.D.F.  Method  can  possibly  achieve,  as  far  as  the 
present  data  are  concerned. 

The  fact  that  the  Normal  Approach  Method  has  provided  us  with 
results  as  good  as  those  produced  by  the  Two-Parameter  Beta  Method 
somewhat  puzzles  us,  however,  since  the  normal  density  function  does 
not  have  the  kind  of  variety  in  shape  as  the  Beta  density  function  does. 
There  is  a strong  possibility  that  the  "too  good"  results  by  the  Normal 
Approach  Method  are  partly  due  to  the  nature  of  the  simulation  data, 
and  this  will  be  discussed  in  a later  section. 

Tables  3-i  and  3-2  present  the  estimated  discrimination  para- 
meters and  difficulty  parameters  respectively,  for  the  ten  binary  items, 
using  the  range  of  the  estimated  item  characteristic  function,  [0.05,  0.95], 
within  the  interval  of  6 , [-2.4^  2.4].  The  same  least  square  procedure 
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Estimated  Item  Characteristic  Functions  by  the  Normal  Approach  Method  in  Degree  3 
Case  (Broken  Curve)  and  in  Degree  4 Case  (Dotted  Curve),  with  the  Criterion  Item 
Characteristic  Function  (Thin  Solid  Curve),  the  Frequency  Ratios  of  0 (Broken 
and  Dotted  Line)  and  the  True  Item  Characteristic  Function  (Thick  Solid  Curve) 
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TABLE  3-1 

Discrimination  Parameter  and  Its  Estimates  of  Each  of  the  Ten 
Binary  Items  Obtained  from  the  Estimated  Item  Characteristic 
Functions  by  the  Conditional  P.D.F.  Method  of  the  Normal  Approach 
Method,  with  the  Corresponding  Estimate  Obtained  from  the  Cri- 
terion Item  Characteristic  Function:  The  Range  of  Each  Estimated 
Item  Characteristic  Function  Used  Is  (0.05,  0.95],  within  the 

Interval  of  0 , [-2.4,  2.4] 


METHOD 


ITEM 

TRUE 

a 

8 

a from 
g 

DGR.3 

0.05- 

0.95 

a f rom 
g 

DGR.4 

0.05- 

0.95 

a f rom 
g 

CRITERION 

0.05- 

0.95 

1 

1 

1.5 

1.171 

1.179 

1.400 

5 

5 

5 

2 

1.0 

1 .055 

1.078 

1.024 

3 

2.5 

1.793 

1.846 

1.788 

4 

1.0 

0.883 

0.882 

0.868 

5 

1.5 

1.382 

1.366 

1.368 

6 

1.0 

0.905 

0.833 

0.895 

7 

2.0 

1.484 

1.476 

1.473 

8 

1.0 

0.887 

0.918 

0.886 

9 

2.0 

1.673 

1.685 

1.716 

10 

1.0 

0.714 

0.717 

0.725 

The  number  of  Intervals  used  In  estimation  Is  shown  as  a subscript 
when  It  Is  less  than  6 . 
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TABLE  3-2 

Difficulty  Parameter  and  Its  Estimates  of  Each  of  the  Ten  Bi- 
nary Items  Obtained  from  the  Estimated  Item  Characteristic  Fun- 
ctions by  the  Conditional  P.D.F.  Method  of  the  Normal  Approach 
Method,  with  the  Corresponding  Estimate  Obtained  from  the  Cri- 
terion Item  Characteristic  Function:  The  Range  of  Each  Esti- 
mated Item  Characteristic  Function  Used  Is  [0.05,  0.95], 
within  the  Interval  of  6 , [-2. A,  2.4] 


METHOD 


ITEM 

TRUE 

b 

g 

b from 
g 

DGR.3 

0.05- 

0.95 

b from 
g 

DGR.A 

0.05- 

0.95 

b from 
g 

CRITERION 

0.05- 

0.95 

1 

-2.5 

-2.792 

-2.799 

-2.651 

5 

5 

5 

2 

-2.0 

-1.966 

-1.957 

-2.002 

3 

-1.5 

-1.A9A 

-1.A97 

-1.507 

A 

-1.0 

-0.990 

-0.989 

-1.005 

5 

-0.5 

-0.A68 

-0.A72 

-O.A72 

6 

0.0 

-0.073 

-0.0A8 

-0.075 

7 

0.5 

0.522 

0.527 

0.527 

8 

1.0 

0.939 

0.958 

0.981 

9 

1.5 

1.502 

1.508 

1.502 

10 

2.0 

2.128 

2.131 

2.118 

Th  e numb  e 

r of  intervals 

used  in 

estimation  Is 

shown  as  a subscript 

when  It  Is  less  than  6 . 


I 

I 


was  used  by  changing  the  range  of  the  estimated  Item  characteristic 

function  to  (0.01,  0.99),  [0.10,  0.90]  and  [0.15,  0.85)  respectively, 

and  the  corresponding  results  are  given  In  Appendix  I,  as  Table  A-1-1 

for  the  discrimination  parameter  a and  as  Table  A-1-2  for  the 

g 

difficulty  parameter  b^  . ) 

The  estimated  parameter  values  In  Tables  3-1  and  3-2  are  very 
close  to  those  of  the  criterion  Item  characteristic  functions,  except 

for  Item  1 , i.e.,  the  easiest  item  with  a relatively  high  discrimlna- 

I 

t Ion  parameter,  and  sometimes  are  better  than  those  of  the  criterion 
Item  characteristic  fvinctions.  The  exceptional  result  for  item  1 
Is  obviously  due  to  the  fact  that  the  main  part  of  the  estimated 
Item  characteristic  function  which  is  used  for  the  parameter  estima- 
tion is  outside  the  interval  of  0 , [-2.0,  2.0),  as  we  can  see  in 
Figure  3-1.  It  should  also  be  noted  that  the  present  results  are 
very  similar  to  those  obtained  by  the  Conditional  P.D.F.  Method  of  the 
Two-Parameter  Beta  Method  (cf.  Samejima,  1978,  Tables  6-1  and  6-2). 

Figures  3-2  and  3-3  present  the  estimated  probability  density 

A 

function  f(0)  , in  Pegree  3 and  4 Cases  respectively,  by  heavy  dotted 

I curves.  Tn  these  figures,  also  presented  are  corresponding  results 

( 

1 by  the  Conditional  P.P.F.  Method  of  the  Two-Parameter  Beta  Method  by 

I broken  curves,  those  from  the  true  4)(6|0)  by  solid  curves,  and  the 

I 

j theoretical  f(0)  by  dashed  lines.  Since  the  total  number  of  subjects 

i 

used  in  the  Normal  Approach  Method  is  499  in  Pegree  3 Case  and  486  in 
Pegree  4 Case,  the  slanted  area  in  the  viniform  density,  f(0)  , 

should  be  discarded  in  ev.aluat  Ing  the  closeness  of  the  result  of  the 
Normal  Approach  Method,  in  each  figure.  For  an  additional  Information, 
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l 

in  each  graph,  slanted  lines  in  the  opposite  direction  are  used  to 
indicated  the  area  to  be  discarded  in  evaluating  the  result  of  the 
Two-Parameter  Beta  Method,  to  make  the  total  number  of  subjects  499 
In  Degree  3 Case  and  493  in  Degree  4 Case. 

These  two  figures  indicate  that  the  estimated  probability  density 
function  of  9 is  very  close  to  that  of  the  Two-Parameter  Beta  Method, 

1 

I and  is  reasonably  close  to  both  the  theoretical  and  "semi-theoretical" 

' functions  within  the  Interval  of  6 , (-2.0,  2.0),  in  both  Degree  3 

I 

and  4 Cases.  It  should  be  noted  that  the  fit  is  slightly  better  in 
Degree  4 Case  outside  this  interval  of  0 , which  is  anticipated  from 
the  fact  that  the  probability  density  function  of  9 is  approximated  by 
a polynomial  of  a higher  degree  in  Degree  4 Case. 
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IV  Pearson  System  Method 

This  method  also  belongs  to  the  Conditional  P.D.F.  Method.  So 
far,  in  the  other  methods,  some  specific  mathematical  formula  was 
assumed  for  the  conditional  density  function  it'(0|0)  , and  used  in 
(2. A)  to  obtain  the  estimated  item  characteristic  function  • 

In  the  present  method,  however,  we  let  the  conditional  moments  of  6 
given  6 , decide  which  mathematical  formula  should  be  used  for  a 
specific  value  of  the  maximum  likelihood  estimate,  or  for  a specific 
examinee,  out  of  all  the  Pearson  system  density  functions.  For  this 
reason,  the  method  is  called  the  Pearson  System  Method. 

In  so  doing,  we  need  the  Pearson's  criterion  ic  (Elderton  and 
Johnson,  1969;  Johnson  and  Kotz,  1970),  defined  by 

(A.l)  < - + 3)^[4(2e2  - 33^  - 6)(A62  - 30^)]“^  , 

where  3,  and  6 are  obtained  from  the  conditional  moments  such  that 
1 2 

(A. 2)  “ {E([e  - e(0|9)]^|0)}^{e([O  - e(o|0)1^|9)}~^ 


(A. 3)  B,  = E(10  - E(0|0)1‘‘|0){E(0  - E(0|0)l*|0)r^  . 


If,  for  Instance,  < turned  out  to  be  negative  and  finite,  then  the 
distribution  should  be  of  Pearson’s  Type  1,  or  a Beta  distribution,  and, 
if  it  is  a positive  value  less  than  unity,  then  it  should  be  of  Pearson's 
Type  IV,  and  so  on.  In  computing  < for  each  value  of  the  maximum 
likelihood  estimate,  we  need  the  third  and  fourth  conditional  moments 
of  0 , given  0 , which  are  given  by  the  following  formulae. 

(The  first  and  second  moments  necessary  for  (A. 2)  and  (A. 3)  are  the 
conditional  expectation  and  variance  given  as  (2.2)  and  (2.3).) 
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(4.4) 

(4.5) 


Ei{0  - E(erd)}'rei  - - o®i-|^iog  g(6)i  . 

E({o  - E(old)}‘'|e] 

- o‘'13  + 6o*{-^log  g(G)}  + 3o‘'{--^log  g(§)}* 


dO 


d0‘ 

+ log  g(§) 


The  second  through  fourth  derivatives  of  log  g(0)  are  given  as 
follows . 


(4.6)  -^logg(0)  “ (g(S)‘  ^g(G)  - g(6))*Hg(§)] 


((g(6)}'- J^g(6)  - 3g(6)-^^  g(0) --1^8(0) 
+ 2t-|g-  g(0)}'l[g(e)]"^  . 


(4.8) 


j-gT.  log  g(0) 


[{g(0)}^*  d'*^8(6>  - ^fg(G)  ■jig'  g(O)*-^pg(0) 


- 3{g(0)}'{-|^g(0)}^  + 12g(6){ g(0)}'-‘^pg(6) 

- 6{-^'g-  g(0)  I**]  [g(0)  ] ^ . 

After  a specific  type  of  function  has  been  selected  according  to  the 
value  of  the  criterion  K for  each  value  of  the  maximum  likelihood 
estimate  , or  for  each  examinee  s , the  conditional  di’nsity  function  of 
0 , given  0 , is  estimated  by  the  method  of  moments,  and  used  as 

$(6|0  ) in  (2.4),  to  obtain  the  estlnuited  item  characteristic  function. 

Ttie  est  Itn.Jted  probability  density  function,  f(0)  , is  obtained 
ttirough  (2.5),  using  the  est  im.'«te<l  ctuid  1 1 ional  density  ^(0|0^)  for 
e.ach  examinee  s , as  an  .additional  information. 

As  we  can  see  in  (4.1),  Pearson's  criterion  tc  requires  the  first 

/N 

four  conditional  moments  of  0 , given  0 . This  fact  Implies  that 


A 


the  method  is  useless,  or  even  harmful,  unless  the  estimation  Is 
accurate  up  to  the  fourth  conditional  moments  of  6 , given  6 . 

It  Is  terestlng  to  find  out,  therefore.  If  the  method  works  with 
the  present  data,  which  consist  of  only  five  hundred  observations,  and 
In  which  the  method  of  moments  Is  used  for  graduating  the  set  of  five 
hundred  maximum  likelihood  estimates  by  a polynomial  of  degree  3 or 
4 . If  the  estimation  of  the  conditional  moments  Is  accurate  enough, 
then  the  Pearson  System  Method  should  have  advantage  over  the  Normal 
Approach  Method,  since  It  allows  a variety  of  different  shapes  for  the 
conditional  density  of  0 , given  6 . 


PI 
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V Results 

A 

The  classif Iction  of  the  500  maximum  likelihood  estimates  0 
with  respect  to  the  types  of  their  conditional  distribution  of  6 
has  been  made,  using  the  first  four  estimated  conditional  moments 
of  6 In  computing  Pearson's  criterion  K , which  Is  given  by 
(4.1).  The  detailed  results  are  shown  In  an  earlier  research 
report  (Saraejlma,  1977d,  Tables  A-1-1  and  A-1-2),  In  both  Degree 

3 and  4 Cases.  To  summarize,  In  Degree  3 Case,  318  distributions 
are  of  Pearson's  Type  I,  181  are  normal  distributions,  and  for  one 
case  the  distribution  Is  undefined  because  of  the  negative  value 
of  the  estimated  fourth  conditional  moment;  in  Degree  4 Case, 

432  distributions  are  of  Type  I and  54  are  of  Type  II,  and  for  13 
cases  the  distribution  is  undefined  because  of  the  negative  value 
of  the  estimated  fourth  moment,  and  sometimes  of  the  negative  value 
of  the  estimated  second  moment  as  well,  and  for  one  case  It  is 
undefined  because  of  the  negative  value  of  the  estimated  probability 
density  of  6 . Thus,  except  for  the  one  undefined  distribution  In 
Degree  3 Case  and  for  the  fourteen  undefined  dlstribvit ions  In  Degree 

4 Case,  all  the  other  conditional  distributions  turned  out  to  be 
either  Beta  distributions  (Pearson's  Types  I and  II)  or  normal 

d 1st  r Ibut ions . 

TTie  above  results  were  obtained  in  such  a way  that  Type  I 
is  assigned  If  the  criterion  < is  less  tlian,  or  equal  to,  -0.001, 
Type  II  Is  assigned  If  It  Is  greater  than  -0.001  and  less  thaa  0.001 
and  (B^  - 3)  Is  less  than  or  equal  to  -0.001,  and  the  normal 
distribution  Is  assigned  If  (B^  - 3)  Is  greater  than  -0.001  and 

If  we  increase  the  range  of  error  from  '*0.001  to 


less  than  0.001  . 
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t0.025,  however,  the  configurations  of  the  frequencies  change  sub- 
stantially, l.e.,  in  Degree  3 Case,  only  6 lilstrlbut ions  are  of  Type  1, 

10  are  of  Type  II,  and  483  are  normal  distributions,  whereas  in  Degree 
4 Case  these  frequencies  are  41,  41  and  404  respectively.  This  rather 
radical  change  in  the  configurations  of  different  types  of  distributions 
in  both  Degree  3 and  4 Cases  takes  us  as  surprise,  but  a close  examination 
of  the  values  of  62  reveals  that  many  of  them  are  very  close  to  3 , 
like  2.999,  2.998,  etc.  (cf.  Samejlma,  1977d,  Tables  A-1-1  and  A-1-2) , 
and  also  there  are  many  values  of  the  criterion  < which  are  negative,  but 
very  close  to  zero,  like  -0.001,  -0.002,  etc.  For  this  reason,  it  will 
be  meaningless  to  treat  them  as  Pearson's  Type  1 cases,  since  they  are 
practically  normal  distributions.  Tlie  second  range  of  error,  iO.025, 
therefore,  was  adopted  in  the  present  study. 

Tlius  for  the  483  values  of  the  maximum  likelihood  estimate  in 
Degree  3 Case  and  for  the  404  values  in  Degree  4 Case  the  conditional 
density  function  of  6 , given  0 , Is  approximated  by  4'(0|G)  given 
by  (2.6).  For  the  other  values  of  the  maximum  likelihood  estimate 
it  Is  approximated  by  a Beta  density  function  such  that 

(5.1)  $(0|0)  = [B(pg,qg)]’^  (0-ag)P0“\bg-0)‘'0"^(bg-ag)"^P0^‘»e"^^  , 


where  B(p'',q'')  is  the  Beta  function  with  the  parameters  p*  and  qg  , 

0 0 U 0 

and  ag  and  bg  are  the  other  two  parameters  of  the  Beta  density  function, 
o o 

This  Inclndtsboth  Type  I and  Type  II  density  functions  with  pg  qg 
for  Type  I and  pg  ” 9g  for  Type 

Tlic  four  parameters  of  the  Beta  ih-nslty  function  are  obtained 
from  the  first  four  conditional  moments  of  0 , given  9 , through 
the  following  formulae. 


(5.2)  r - 6(02-6^-!)  / (&+30^-2B2)  • 

(5.3)  pg.  qg  - (r/2)[l  ± (rf2){B^I6j(r+2)^  + 16(r+l) ] . 

(5.4)  bg  - ag  - {E[(e  - E[el§])''|6]}^^^{B^(ir+2)^  + 16(r+l)}^^^  /2 


(5.5) 


ag  = E[e|e]  - pg(bg-ag)/r 


(5.6)  bg  - E[e|§]  + qg(bg-ag)/r 


Since  • 0 for  the  Type  II  category,  It  Is  easily  seen  from  (5.3) 


that  In  this  case 


(5.7) 


Pg  “ qg  = r/2  . 


In  programming  this  process  for  the  computer,  the  subroutine  for 


the  gamma  function  was  used  by  virtue  of  the  relationship 


(5.8)  B(p0.qg)  = [ ^’(pg+qg)  1 


Because  of  the  restriction  of  the  size  of  the  parameter  of  the  gamma 
function  for  the  subroutine,  the  following  approximation,  which  is 
obtained  from  the  Stirling's  Formula, 

(5.9)  B(pg,qg)  - (21T)^^^  IPg^^®  ^*10^**®  2(pg+qg)jl/2  ^ 

was  used  when  (pg+qg)  exceeds  57  and  both  pg  and  qg  are  greater 


than  15,  and,  in  similar  situations. 


(5.10)  B(pg,qg) 


r = r (qg)  Pg  ‘^6 
1“  r(pg)  qg'P§ 


e for  qg  ^ 15  , 


9 for  pg  $ 15 


were  used,  however. 


I 

i 

I 


I 

i 
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T!ie  estimated  four  parameters  of  the  Beta  density  fvmctlon 
for  each  of  the  6 examinees  of  Type  1 and  the  10  examinees  of  Type 
II  in  Degree  3 Case  Is  presented  in  Tables  A-2-1  and  A-2-2  of  Appendix 
II,  and  those  for  each  of  the  41  examinees  of  Type  I and  the  41 
examinees  of  Type  11  In  Degree  4 Case  Is  shown  in  Tables  A-2-3 
and  A-2-4.  We  notice  that  In  Table  A-2-3  the  two  parameters, 

Pg  and  qg  , for  Subjects  100,  104  and  l^tS  turned  out  to  be 

0 0 

negative,  although  they  are  very  close  to  zero.  For  this  reason, 
these  three  subjects  are  excluded  from  the  total  group  of  subjects 
In  Degree  4 Case,  to  make  the  total  number  of  subjects  483,  l.e., 
three  less  than  the  one  In  the  Normal  Approach  Method,  whereas  In 
Degree  3 Case  the  total  nvimber  of  subjects  Is  49*),  as  It  was  In  the 
Normal  Approach  Method. 

It  Is  apparent  in  Tables  A-2-2  and  A-2-4  that  for  these 
examinees  the  parameters  pg  and  qg  are  not  really  one  half  of 
the  value  of  r , and  In  some  cases  the  difference  Is  svibst  ant  lal . 

This  fact  is  due  to  the  relatively  "generous"  amount  of  error  permitted 
In  the  categorization  of  the  subjects  with  respect  to  Pearson’s 
criterion  < and  ^2  • this  reason,  the  computation  ol  the 

conditional  density  was  performed  through  (5.1),  Just  as  It  was  lor 
the  subjects  of  Type  I,  without  recalculating  pg  and  qg  through 
(5.7). 

To  check  the  accuracy  of  the  approximation  \islng  Stirling's 
Formula,  (5.1)  w.as  used  by  replacing  the  Beta  function  bv  (5.**)  for 
all  the  six  subjects  of  Type  I In  Degree  3 Case  and  the  thirty  eight 
subjects  of  Type  I In  Degree  4 Case.  Table  5-1  presi'nts  two  examples 


from  these  results,  whose  parameter  values  are  relatively  small,  but 


i 


1' 

I 

I' 


f! 

r 


i 
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TABLE  5-1 

Comparison  of  Pearson's  Type  I Density  Function  with  the  One 
Approximated  by  Stirling's  Formula  When  the  Parameter  Values 
Are  Relatively  Small 

Subject  101  Subject  392 


P0 

- 11.9187 

qg  - 8.1981 

- 10.2720 

qg  - 15.5651 
b 

e 

True 

Approxi- 

mation 

0 

True 

Approxi- 

mation 

-3.6 

0.00000 

0.00000 

■W 

0.00009 

0.00010 

-3.4 

0.00137 

0.00139 

1.8 

0.06382 

0.06448 

-3.2 

0.06110 

0.06190 

2.0 

0.76473 

0.77261 

-3.0 

0.51138 

0.51808 

2.2 

1.86010 

1.87927 

-2.8 

1.52044 

1.54037 

2.4 

1.62962 

1.64642 

-2.6 

1.90820 

1.93320 

2.6 

0.59455 

0.60067 

-2.4 

0.90790 

0.91979 

2.8 

0.08366 

0.08453 

-2.2 

0.08937 

0.09054 

3.0 

0.00324 

0.00327 

-2.0 


0.00006  0.00006 


3.2 


0.00001  0.00001 
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not  too  small.  As  we  can  see  in  this  table,  even  with  relatively 
small  parameter  values  like  11.9187  and  8.1981  or  10.2720  and  15.5651 
the  approximation  using  Stirling's  Formula  for  the  gamma  functions 
through  (5.9)  provides  us  with  considerably  good  results,  although 
there  is  no  need  to  use  the  approximation  in  cases  like  them.  For 
further  information  as  to  how  the  approximation  works,  a similar 
comparison  was  made  for  each  of  the  six  subjects,  whose  parameter 
values  are  given  in  Table  A-2-1,  of  Pearson  Type  1 in  Degree  3 Case 

and  is  presented  in  Table  A-2-5  in  Appendix  II,  and  also  for  each 

of  the  thirty  four  subjects,  whose  parameter  values  are  given  in 
Table  A-2-2,  the  sum  of  which  does  not  exceed  57,  of  Pearson  Type  I 
in  Degree  A Case,  and  is  presented  as  Table  A-2-6,  and  for  each  of 
two  subjects  of  Pearson  Type  II  in  Degree  A Case,  whose  parameter 
values  are  given  in  Table  A-2-A,  the  sum  of  which  is  less  than  57, 

and  is  presented  as  Table  A-2-7.  These  results  indicate  that  the 

approximation  is  not  only  good  enough  for  larger  values  of  the  parameters, 
but  also  reasonably  good  for  considerably  small  values,  although  for 
some  subjects  whose  parameters  are  extremely  small,  like  Subject  397, 
the  discrepancies  are  larger. 

Figure  5-1  presents  the  estimated  item  characteristic  functions 
obtained  by  the  Pearson  System  Method  for  Degree  ’’  Case  (broken  curve) 
and  for  Degree  A Case  (dotted  curve),  together  with  the  criterion  Item 
characteristic  function  (thin,  solid  curve)  and  the  frequency  ratio 
(broken  and  dotted  curve)  of  the  "success"  group  of  individuals  to  the 
total  group  for  each  subinterval  of  6 with  the  width  of  0.25  , for 
each  of  the  ten  binary  items.  The  results  are  almost  identical  with 
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Estimated  Item  Characteristic  Functions  by  the  Pearson  System  Method  in  Degree  3 
Case  (Broken  Curve)  and  in  Degree  4 Case  (Dotted  Curve),  with  the  Criterion  Item 
Characteristic  Function  (Thin  Solid  Curve),  the  Frequency  Ratios  of  6 (Broken 
and  Dotted  Line)  and  the  True  item  Characteristic  Function  (Thick  Solid  Curve) 
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those  of  the  Normal  Approach  Method  not  only  in  Degree  3 Case 
where  only  sixteen  individuals  have  different  density  functions  from 
normality,  but  also  in  Degree  A Case  where  seventy  nine  examinees 
have  Pearson's  Type  I or  II  density  functions  and  three  individuals 
are  excluded.  In  other  words,  except  for  the  range  of  6 outside 
the  Interval  [-2.0,  2.0],  these  two  curves  are  practically  identical 
with  the  criterion  item  characteristic  function,  for  each  and  every 
item. 

Table  5-2  presents  the  estimated  discrimination  parameters  for 
the  ten  binary  items  by  the  same  least  squares  method  used  earlier, 
and  the  corresponding  estimated  difficulty  parameters  are  shown  in 
Table  5-3.  Just  as  in  the  Normal  Approach  Method,  these  values  are 
very  close  to  those  obtained  from  the  criterion  item  characteristic 
functions,  except  for  item  1.  In  these  estimations,  the  Interval 

A 

of  0 used  is  [-2.4,  2. A],  and  the  range  of  P (0)  included  is 

S 

[0.05,  0.95].  As  usual,  similar  estimates  were  obtained  by  changing 
the  range  of  Pg(0)  to  [0.15,  0.85),  [0.10,  0.90]  and  [0.01,  0.99] 
respectively,  and  the  results  are  shown  in  Appendix  II  as  Tables 
A-2-8  and  A-2-9. 

These  results  indicate  that,  as  far  as  the  present  set  of  data 
are  concerned,  the  Pearson  System  Method  works  Just  as  good  as  the 
Normal  Approach  Method,  and  the  estimation  has  attained  to  the  level 
where  the  Conditional  P.D.F.  Method  can  possibly  attain.  It  is  worth 
noting,  however,  that  the  Pearson  System  Method,  which  has  more  theo- 
retical advantages  than  the  Normal  Approach  Method,  did  not  produce 
better  results  than  the  Normal  Approach  Method.  In  fact,  there  is 
a tendency  that  for  very  easy  and  very  difficult  items  for  which  the 


TABLE  5-2 

Discrimination  Parameter  and  Its  Estimates  of  Each  of  the  Ten 
Binary  Items  Obtained  from  the  Estimated  Item  Characteristic 
Functions  by  the  Conditional  P.D.F.  Method  of  the  Pearson  System 
Method,  with  the  Corresponding  Estimate  Obtained  from  the  Cri- 
terion Item  Characteristic  Function;  The  Range  of  Each  Estimated 
Item  Characteristic  Function  Used  Is  [0.05,  0.95),  within  the 

Interval  of  0 , [-2.4,  2.4] 


METHOD 


ITEM 

TRUE 

a 

g 

a from 
g 

DGR.3 

0.05- 

0.95 

a f rom 
g 

DGR.4 

0.05- 

0.95 

a from 
g 

CRITERION 

0.05- 

0.95 

1 

1.5 

1.177 

1.090 

1.400 

5 

5 

5 

2 

i 

1.0 

1.053 

1.097 

1;024 

3 

2.5 

1.792 

1.838 

1.788 

1.0 

0.883 

0.880 

0.868 

5 

1.5 

1.382 

1.366 

1.368 

6 

1.0 

0.905 

0.897 

0.895 

7 

2.0 

1.484 

1.475 

1.473 

8 

1.0 

0.887 

0.905 

0.886 

9 

2.0 

1.673 

1.653 

1.716 

10 

1.0 

0.714 

0.707 

0.725 

The  number  of  intervals 

used  in 

estimation  is 

shown  as  a subscript 

when  it  is  less  than  6 . 


L . ^ - a 


TABLE  5-3 

Difficulty  Parameter  and  Its  Estimates  of  Each  of  the  Ten  Bi- 
nary Items  Obtained  from  the  Estimated  Item  Characteristic  Fun- 
ctions by  the  Conditional  P.D.F.  Method  of  the  Pearson  System 
Method,  with  the  Corresponding  Estimate  Obtained  from  the  Cri- 
terion Item  Characteristic  Function:  The  Range  of  Each  Esti- 
mated Item  Characteristic  Function  Used  Is  [0.05,  0.95], 
within  the  Interval  of  6 , [-2. A,  2.4] 


METHOD 


ITEM 

TRUE 

b 

g 

b from 
g 

DGR.3 

0.05- 

0.95 

b from 
g 

DGR.4 

0.05- 

0.95 

b from 
g 

CRITERION 

0.05- 

0.95 

1 

-2.5 

-2.788 

-2.884 

-2.651 

5 

5 

5 

2 

-2.0 

-1.966 

-1.942 

-2.002 

3 

-1.5 

-1.494 

-1.498 

-1.507 

4 

-1.0 

-0.990 

-0.991 

-1.005 

5 

-0.5 

-0.468 

-0.472 

-0.472 

6 

0.0 

-0.073 

-0.073 

-0.075 

7 

0.5 

0.522 

0.527 

0.527 

8 

1.0 

0.939 

0.967 

0.981 

9 

1.5 

1.502 

1.515 

1.502 

10 

2.0 

2.128 

2.148 

2.118 

The  number  of  intervals  used  in  estimation  is  shown  as  a subscript 
when  it  is  less  than  6 . 
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difference  between  normal  density  functions  and  Beta  density  functions 
is  expected  to  show,  the  estimation  of  the  parameters  Is  slightly 
worse  in  Degree  A Case,  although  in  Degree  3 Case  these  two  sets  of 
estimates  are  practically  identical. 

Figures  5-2  and  5-3  present  the  estimated  density  function  of 
0 (dashed  curve),  together  with  the  one  obtained  by  the  Two-Parameter 
Beta  Method  (broken  curve),  the  average  of  the  true  conditional  density 
functions  (solid  curve)  and  theoretical  density  function  f(6)  (dashed 
line).  Since  we  had  to  exclude  three  more  subjects  from  the  A86  subjects 
in  Degree  A Case,  they  are  excluded  from  the  two  extreme  subintervals  of 
0 , to  make  the  total  483. 

It  is  observed  that,  in  both  Degree  3 and  A Cases,  the  estimated 
density  function  by  the  Pearson  System  Method  Is  slightly  closer  to  the 
average  of  the  true  conditional  density  functions  for  the  500  subjects 
than  the  one  obtained  by  the  Two-Parameter  Beta  Method.  Also  the  same 
is  true  if  we  compare  them  with  the  results  obtained  by  the  Normal 
Approach  Method,  which  are  shown  in  Figures  3-2  and  3-3. 
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Functions  of  6 , Given  Its  Maximum  Likelihood  Estimate,  In  Degree  4 Case  of  the  Pearson 
System  Method (Dashed  Curve),  with  the  Corresponding  Result  by  the  Two-Parameter  Beta 
Method (Broken  Curve),  Along  with  the  Density  Function  Obtained  from  the  500  True  Condi- 
tional Density  Func tlons(Solld  Curve),  and  f(0)  , the  Theoretical  Density  Function  of 

6 (Dashed  Line) 
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VI  Comparison  of  the  Approximated  Conditional  Density  Functions 

Figure  6-1  presents  a typical  set  of  the  approximated  conditional 
density  functions  of  0 , given  6 , l.e.,  the  normal  density  function 
(dashed  curve),  which  belongs  to  both  the  Pearson  System  Method  and  the 
Normal  Approach  Method,  and  the  Beta  density  function  (broken  curve), 
which  belongs  to  the  Two-Parameter  Beta  Method.  In  this  example  of 
Subject  50,  in  both  Degree  3 and  4 Cases,  the  normal  density  function  is 
almost  identical  with  the  true  conditional  density  function,  which  is 
drawn  by  a solid  curve,  while  the  Beta  density  function  is  flatter  than 
them. 

In  contrast  to  the  above  example.  Figure  6-2  presents  somewhat 
different  relationships.  In  this  example  of  Subject  500,  while  the 
relationship  between  the  normal  density  function  and  the  Beta  density 
function  stays  the  same,  they  are  substantially  different  from  the  true 
conditional  density  function,  especially  in  Degree  3 Case. 

In  the  other  two  examples  in  Figure  6-3,  the  normal  density 
functions  are  consistently  closest,  including  the  Beta  density  functions 
which  belong  to  the  Pearson  System  Method  (Broken  and  dotted  curves). 

This  is  rather  an  interesting  result,  indicating  that  the  normal  approx- 
imation is  better  than  the  Beta  approximation,  even  though  the  latter 
uses  the  four  conditional  moments  rather  than  two. 

In  Appendix  III,  Figure  A-3-1  presents  42  pairs  of  such  comparisons, 
which  show  the  general  tendency.  These  42  individuals  were  selected 
from  the  total  493  subjects  used  in  Degree  4 Case  of  the  Two-Parameter  Beta 
Method,  starting  from  Subject  1 and  then  picking  up  every  twelve  subject. 

In  both  graphs  of  Degree  3 Case  and  Degree  4 Case  for  each  subject. 
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the  true  conditional  density  of  6 , given  0 , is  drawn  by  a solid 
curve  for  the  sake  of  comparison.  From  this  sample  of  42  subjects, 
it  is  clear  that  the  configuration  exemplified  by  the  two  graphs  for 
Subject  50,  i.e..  Figure  6-1,  is  true  for  the  majority  of  the  subjects. 
Little  discrepancy  lies  between  the  normal  density  curve  and  the  true 
conditional  density  function,  and  the  results  are  so  similar  between 
Degree  3 and  4 Cases,  for  these  subjects.  The  configuration  exemplified 
by  Figure  6-2  for  Subject  500  is  recognized  for  subjects  with  extreme 
values  of  the  maximum  likelihood  estimate  in  both  positive  and  negative 
direction,  and  the  estimates  are  much  closer  to  the  true  conditional 
density  function  in  Degree  4 Case  than  in  Degree  3 Case,  for  these 
subjects.  This  reflects  the  fact  that  in  Degree  4 Case  the  fit  of 
the  polynomial  to  g(0)  is  better  than  in  Degree  3 Case  because  of 
the  use  of  a polynomial  of  a higher  degree,  especially  at  the  both 
extreme  ends  of  6 . This  did  not  affect  the  main  parts  of  the 
estimated  item  characteristic  functions  of  the  ten  binary  items,  however, 
as  wo  have  seen  in  Figure  3-1  and  Figure  5-1. 


The  conditional  probability  density  of  6,  given  0 (Solid  Curve),  and  its  estimates  by 
the  Normal  Approach  Method  (Dashed  Curve)  and  by  the  Two-Parameter  Beta  Method  (Bro- 
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FIGURE  6-2  (Continued) 
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(Broken  Curve).  (The  estimated  density  by  the  Pearson  System  Method  is  the 

the  one  by  the  Normal  Approach  Method.) 


The  estimate  by  the  Pearson  System  Method  (Broken  and  Dotted  Curve)  Is  different  from 
the  one  by  the  Normal  Approach  Method  (bashed  Curve) . 
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VII  Discussion  and  Conclusion 

We  have  seen  the  results  of  the  Two-Parameter  Beta  Method,  of 
the  Normal  Approach  Method,  and  of  the  Pearson  System  Method,  all  of 
which  belong  to  the  Conditional  P.D.F.  Method,  in  addition  to  those 
obtained  by  the  Histogram  Ratio  Method  (Samejlma,  1977d,  1978)  and 
by  the  Curve  Fitting  Method  (Samejima,  1978)  in  the  context  of  the  Two- 
Parameter  Beta  Method.  It  turned  out  that  all  the  three  in  the  Conditional 
P.D.F.  Method  have  produced  highly  satisfactory  results  as  far  as  the 
present  simulated  data  are  concerned. 

This  is  rather  unexpected,  considering  that  each  method  has 
somewhat  different  characteristics.  It  should  be  recalled,  however, 
that,  with  the  present  simulated  data,  the  majority  of  the  conditional 

A 

density  functions  of  0 , given  6 , are  normal  density  functions  in 
the  Pearson  System  Method,  and  it  is  natural  that  both  the  Pearson 
System  Method  and  the  Normal  Approach  Method  produce  almost  identical 
results.  It  is  desired,  therefore,  to  use  different  types  of  data 
in  addition  to  the  present  ones,  before  we  try  to  extract  some  definite 
conclusion  about  their  characteristics. 

The  comparison  of  the  estimated  conditional  density  functions 
has  revealed  that,  in  general,  the  normal  density  function  fits  slightly 
better  to  the  true  conditional  density  function  than  the  Beta  density, 
however.  This  may  indicate  that  the  counterbalance  of  the  use  of  the 
higher  conditional  moments  and  the  inflexibility  of  the  shape  of  the 
function  is  in  favor  of  the  latter. 

Since  we  have  succeeded  in  attaining  the  level  of , estimation  that 
we  can  possibly  hope  for  as  far  as  the  present  data  are  concerned,  we 


I 


should  direct  ourselves  to  overcome  the  limitation  of  the  criterion  oper- 
ating characteristic  now.  One  conceivable  way  is  to  try  to  approach 

A 

the  joint  density  function  of  6 and  6 for  each  item  score  group. 
Instead  of  approaching  the  conditional  density  function  of  6 , given 


0 . This  orientation  is  closer  to  the  Normal  Approximation  Method 

which  the  author  has  tried  previously  (Samejlma,  1977b). 
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rlminatlon  Parameter  and  Its  Estimates  of  Each  of  the  Ten  Binary  Items  Obtained  by  the  Pearson  Sys 
Method,  with  the  Estimate  Obtained  from  the  Criterion  Item  Characteristic  Function,  Using  Each  of 
Four  Different  Ranges  of  the  Estimated  Item  Characteristic  Functions,  [0.15,  0.85],  [0.10,  0.90], 
[0.05,  0.95]  and  [0.01,  0.99],  within  the  Interval  of  0 , [-2.4,  2.4]. 
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The  conditional  probability  density  of  6 , given  6 (Solid  Curve) , and  its 
estimates  by  the  Normal  Approach  Method  (Dashed  Curve)  and  by  the  Two-Parameter 
Beta  Method  (Broken  Curve) . The  estimated  density  by  the  Pearson  System  Method 
is  often  the  same  as  that  obtained  by  the  Normal  Approach  Method;  if  not,  it  is 

drawn  by  a broken  and  dotted  curve. 


SUBJECT  SO 


FIGURE  A-3-1  (Continued) 


SUBJECT  112 


AIISNSO  AXniSVBOUd 


AllSNBa  AXniaVBOUd 


AiiiinvnoHd 


AxisNao  AxniavQOdd 


FIGURE  A-3-1  (Continued) 


SOtJCCT  )«« 


FIGURE  A-3-1  (Continued) 


SUBJECT  m I A SUBJECT  209 


FIGURE  A-3-1  (Continued) 


FIGURE  A-3-1  (Continued) 


-107- 


DISTRIBUTION  LIST 


Navy 


Navy 


DR.  JACK  ADAMS  \ 

OFFICE  OF  NAVAL  RES^RCH  BRANCH 
221  OLD  MARYLEBONE  ROAD 
LONDON,  NW,  15TH  ENGL^D 

Dr.  Jack  R.  Borsting 
Provost  & Academic  Dean  \ 

U.S.  Naval  Postgraduate  Sclwol 
Monterey,  CA  939*<0 

Dept,  of  the  Navy 
CHNAVMAT  (NMAT  034D) 

Washington,  DC  20350 

Chief  of  Naval  Education  and 
Training  Support  )-(01A) 

Pensacola,  FL  32509 

Dr.  Charles  E.  Davis 
ONR  Branch  Office 
536  S.  Clark  Street 
Chicago,  IL  60605 

Dr.  Marshall  J.  Farr,  Director 
Personnel  & Training  Research  Progri^s 
Office  of  Naval  Research  (Code  *458)/ 
Arlington,  VA  22217 

DR.  PAT  FEDERICO 
NAVY  PERSONNEL  R&D  CENTER 
SAN  DIEGO,  CA  92152 

CDR  Jonn  Ferguson,  MSC,  USN  / 

Naval  Medical  R4D  Cemnand  (Com  *1*4) 
National  Naval  Medical  Center/ 

Bethesda,  MD  2001*4  / 

/ 

Dr.  Dexter  Fletcher  / 

Navy  Personnel  Research  and /Development 
San  Diego  CA  92152  ' 

I 

I 

Dr.  Eugene  E.  Gloye 
ONR  Branch  Office 
1030  East  Green  Street 
Pasadena,  CA  91101 


/ 

CAPT.  D.M.  G^AGG,  MC , USN 
HEAD,  SECTION  ON  MEDICAL  EDUCATION 
UNIFORMED  ^RVICES  UNIV.  OF  THE 
HEALTH  Sciences 
6917  ARL^IGTON  ROAD 
BETHESD/y;  MD  2001*4 

/ 

Dr.  N^man  J.  Kerr 
Chief/of  Naval  Technical  Training 
Nave,!  Air  Station  Memphis  (75) 
Millington,  TN  3805*4 

Df.  Leonard  Kroeker 
^*avy  Personnel  R4D  Center 
San  Diego,  CA  92152 

CHAIRMAN,  LEADERSHIP  & LAW  DEPT. 
DIV„  OF  PROFESSIONAL  DEVELOPMHENT 
U.S.  NAVAL  ACADEMYY 
ANNAPOLIS,  MD  21*402 

Dr.  James  Lester 
ONR  Branch  Office 
195  Summer  Street 
ton,  MA  02210 

.lliam  L.  Maloy 
I pal  Civilian  Advisor  for 
ition  »nd  Training 
Training  Command,  Code  OCA 
Pensaco^,  FL  32508 


Dr.  James 
Code  301 
Navy  Personn 
San  Diego,  CA 


Pride 


RAD  Center 

92152 


DR.  WILLIAM  KC 
NAVY  PERSONNEL  RA 
SAN  DIEGO,  CA  9215; 


CENTER 


Commanding  Officer 
Naval  Health  Reseerch 
Center 

Attn:  Library 

San  Diego,  CA  92152 


CDR  PAUL  NELSON 

NAVAL  MEDICAL  Ri  D COMMAND 

CODE 

NATIONAL  NAVAL  MEDICAL  CENTER 
BETHESDA,  MD  20014 

DR.  RICHARD  J.  NIEHAUS 
CODE  301 

OFFICE  OF  CIVILIAN  PERSONNEL 
NAVY  DEPT 

WASHINGTON,  DC  20390 
Library 

Navy  Personnel  R&D  Center 
San  Diego,  CA  92152 

Commanding  Officer 
Naval  Research  Laboratory 
Code  2627 

Washington,  DC  20390 

OFFICE  OF  CIVILIAN  PERSONNEL 
(CODE  26) 

DEPT.  OF  THE  NAVY 
WASHINGTON,  DC  20390 


DR.  RICHARD  A.  POLLAK 
ACADEMIC  COMPUTING  CENTER 
U.S.  NAVAL  ACADEMY 
ANNAPOLIS,  MD  21402 

Mr.  Arnold  I.  Rubinstein 
Human  Resoureces  Program  Manager 
Naval  Material  Command  (0344) 

Room  1044,  Crystal  Plaza  #5 
Washington,  DC  20360 

A.  A.  SJOHOLM 
TECH.  SUPPORT,  CODE  201 
NAVY  PERSONNEL  R&  D CENTER 
SAN  DIEGO,  CA  92152 

Mr.  Robert  Smith 

Office  of  Chief  of  Naval  Operations 
OP-987E 

Washington,  DC  20350 

CDR  Charles  J.  Thelsen,  JR.  MSC,  USN 
Head  Human  Factors  Engineering  Div. 
Naval  Air  Development  Center 
Warminster,  PA  18974 


JOHN  OLSEN 

CHIEF  OF  NAVAL  EDUCATION  & 

TRAINING  SUPPORT 
PENSACOLA,  FL  32509 

Office  of  Naval  Research 
Code  200 

Arlington,  VA  22217 

Scientific  Director 

Office  of  Naval  Research 

Scientific  Liaison  Group/Tokyo 

American  Embassy 

APO  San  Francisco,  CA  96503 

SCIENTIFIC  ADVISOR  TO  THE  CHIEF 
OF  NAVAL  PERSONNEL 
NAVAL  BUREAU  OF  PERSONNEL  (PERS  OR) 
RM.  4410,  ARLINGTON  ANNEX 
WASHINGTON,  DC  20370 


W.  Gary  Thomson 

Naval  Ocean  Systems  Center 

Code  7132 

San  Diego,  CA  92152 

DR.  MARTIN  F.  WISKOFF 
NAVY  PERSONNEL  R&  D CENTER 
SAN  DIEGO,  CA  92152 

Thomas  A.  Bryant 

ONR  Resident  Representative 

Office  of  Naval  Research 

University  of  Alabama  Research  Institute 

P.O.  Box  1247 

Huntsville,  AL  35807 


-109- 


Army 


1 HQ  USAREUE  A 7th  Army  1 

ODCSOPS 

USAAREUE  Director  of  CED 
APO  New  York  09403 

1 

1 DR.  RALPH  CANTER 

U.S.  ARMY  RESEARCH  INSTITUTE 
5001  EISENHOWER  AVENUE 

ALEXANDRIA,  VA  22333  1 

1 DR.  RALPH  DUSEK 

U.S.  ARMY  RESEARCH  INSTITUTE 

5001  EISENHOWER  AVENUE  1 

ALEXANDRIA,  VA  22333 

1 Dr.  Milton  S.  Katz 

Individual  Training  & Skill 

Evaluation  Technical  Area  1 

U.S.  Army  Research  Institute 

5001  Eisenhower  Avenue 

Alexandria,  VA  22333 

1 

1 DR.  JAMES  L.  RANEY 

U.S.  ARMY  RESEARCH  INSTITUTE 
5001  EISENHOWER  AVENUE 

ALEXANDRIA,  VA  22333  1 

1 Director,  Training  Development 
U.S.  Army  Administration  Center 
ATTN:  Dr.  Sherrill  1 

Ft.  Penjamin  Harrison,  IN  46218 

1 Dr.  J.  E.  Uhlaner 

Chief  Psychologist,  US  Army 

Army  Research  Institute  1 

693?  Hector  Road 

McLean,  VA  22101 

1 Dr.  Jos*'ph  Ward 

U.S.  Army  Research  Institute 
5001  Eisenhower  Avenue 
Alexandria,  VA  22’3? 


Air  Force 


Air  Force  Human  Resources  Lab 
AFHRL/PED 

Brooks  AFB,  TX  78235 

Air  University  Library 
AUL/LSE  76/443 
Maxwell  AFB,  AL  36112 

Dr.  Alfred  R.  Fregly 
AFOSR/NL,  Bldg.  410 
Bolling  AFB,  DC  20332 

CDR.  MERCER 
CNET  LIAISON  OFFICER 
AFHRL/FLYING  TRAINING  DIV. 
WILLIAMS  AFB,  AZ  85224 

Personnel  Analysis  Division 
HQ  USAF/DPXXA 
Washington,  DC  20330 

Research  Branch 
AFMPC/DPMYP 

Randolph  AFB,  TX  78148 

Dr.  Marty  Rockway  (AFHRL/TT) 

Lowry  AFB 
Colorado  80230 

Major  Wayne  S.  Sellman 
Chief,  Personnel  Testing 
AFMPC/DPMYPT 
Randolph  AFB,  TX  78148 

Brian  K.  Waters,  MaJ.,  USAF 
Chief,  Instructional  Tech.  Branch 
AFHRL 

Lowry  AFB,  CO  80230 


i 


-110- 


Karines  CoastGuard 


Director,  Office  of  Manpower  Utilization  1 
HO,  Marine  Corps  (MPU) 


MR.  JOSEPH  J.  COWAN,  CHIEF 
PSYCHOLOGICAL  RESEARCH  (G-P-1/62) 


U.S.  COAST  GUARD  HO 
WASHINGTON,  DC  20590 


ECB,  Bldg.  2009 
Ouantico,  VA  22134 

1 DR.  A.L.  SLAFKOSKY 

SCIENTIFIC  ADVISOR  (CODE  RD-1) 
HO,  U.S.  MARINE  CORPS 
WASHINGTON,  DC  20?80 

Other  DoD 


12  Defense  Documentation  Center 
Cameron  Station,  Bldg.  5 
Alexandria,  VA  22314 
Attn:  TC 

1 Military  Assistant  for  Human  Resources 
Office  of  the  Director  of  Defense 
Research  4 Engineering 
Room  3D  129,  the  Pentagon 
Washington,  DC  20301 

1 Dr.  Harold  F.  O'Neil,  Jr. 

Advanced  Research  Projects  Agency 
Cybernetics  Technology,  Rm.  623 
HOO  Wilson  Elvd. 

Arlington,  VA  22209 

1 Directo.",  Research  4 Data 
0SD/MRA4L  (Rm.  3E919) 

The  Pentagon 
Washington,  DC  20?01 

1 Mr.  Fredrick  W.  Suffa 
MPP  (A4R) 

2B269 

Pentagon 

Washington,  D.C.  20301 

1 DR.  ROBERT  YOUNG 

ADVANCED  RESEARCH  PROJECTS  AGENCY 
1400  WILSON  ELVD. 

ARLINGTON,  VA  22209 


Civil  Govt 


1 Dr.  William  Gorham,  Director 
Personnel  R4D  Center 
U.S.  Civil  Service  Commission 
1900  E Street  NW 
Washington,  DC  20415 

1 Dr.  Andrew  R.  Molnar 
Science  Education  Dev. 
and  Research 

National  Science  Foundation 
Washington,  DC  20550 

1 Dr.  Thomas  G.  Sticht 
Basic  Skills  Program 
National  Institute  of  Education 
1200  19th  Street  NW 
Washington,  DC  20208 

1 Dr.  Vern  W.  Urry 

Personnel  R4D  Center 
U.S.  Civil  Service  Commission 
1900  E Street  NW 
Washington,  DC  20415 

1 C.S.  WINIEWICZ 

U.S.  CIVIL  SERVICE  COMMISSION 
REGIONAL  PSYCHOLOGIST 
230  S.  DEARBORN  STREET 
CHICAGO,  IL  60604 

1 Dr.  Joseph  L.  Young,  Director 
Memory  4 Cognitive  Processes 
National  Science  Foundation 
Washington,  DC  20550 


r 

-Ill- 

• 

t 

f 

. 

Non  Govt 

Non  Govt 

■ 1 

PROF.  EARL  A.  ALLUISI 

1 

Dr.  Allan  M.  Collins 

DEPT.  OF  PSYCHOLOGY 

Bolt  Eeranek  & Newman,  Inc. 

CODE  287 

50  Moulton  Street 

t 

OLD  DOMINION  UNIVERSITY 

NOr^OLK,  VA  23508 

Cambridge,  Ma  02138 

f 

1 

Dr.  Meredith  Crawford 

1 

Dr.  John  R.  Anderson 

5605  Montgomery  Street 

Dept,  of  Psychology 

Yale  University 

Chevy  Chase,  MD  20015 

jt 

New  Haven,  CT  06520 

1 

DR.  RENE  V.  DAWIS 

DEPT.  OF  PSYCHOLOGY 

1 1 

DR.  MICHAEL  ATWOOD 

UNIV,  OF  MINNESOTA 

1 

SCIENCE  APPLICATIONS  INSTITUTE 

75  E.  RIVER  RD. 

1 

HO  DENVER  TECH.  CENTER  WEST 

MINNEAPOLIS,  MN  55455 

7935  E.  PRENTICE  AVENUE 

ENGLEWOOD,  CO  80110 

1 

Dr.  Ruth  Day 

Center  for  Advanced  Study 

1 

MR.  SAMUEL  BALL 

in  Behavioral  Sciences 

EDUCATIONAL  TESTING  SERVICE 

202  Junipero  Serra  Elvd. 

PRINCETON,  NJ  08540 

Stanford,  CA  94305 

1 

Dr.  Nicholas  A.  Bond 

1 

Dr.  Marvin  D.  Dunnette 

Dept,  of  Psychology 

N492  Elliott  Hall 

Sacranento  State  College 

Dept,  of  Psychology 

600  Jay  Street 

Univ.  of  Minnesota 

■ 

Sacramento,  CA  95819 

Minneapolis,  MN  55455 

1 

Dr.  John  Seeley  Brown 

1 

MAJOR  I.  N.  EVONIC 

Bolt  Eeranek  & Newman,  Inc. 

CANADIAN  FORCES  PERS.  APPLIED  RESEARCH 

50  Moulton  Street 

1107  AVENUE  ROAD 

Cambridge,  MA  02138 

TORONTO,  ONTARIO,  CANADA 

1 

Dr.  John  Carroll 

1 

Dr.  Richard  L.  Ferguson 

i 

Psychometric  Lab 

The  American  College  Testing  Program 

Univ.  of  No.  Carolina 

P.O.  Box  168 

Davie  Hall  013A 

Chapel  Hill,  NC  27514 

Iowa  City,  lA  52240 

1 

1 

Dr.  Victor  Fields 

1 

Dr.  Kenneth  E.  Clark 

Dept,  of  Psychology 

College  of  Arts  & Sciences 

Montgomery  College 

University  of  Rochester 

Rockville,  MD  20850 

River  Campus  Station 

Rochester,  NY  14627 

1 

Dr.  Edwin  A.  Fleishman 

Advanced  Research  Resources  Organ. 

• 1 

Dr.  Norman  Cliff 

8555  Sixteenth  Street 

Dept,  of  Psychology 

Silver  Spring,  MD  20910 

Univ.  of  So.  California 
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Dr.  John  R.  Frederiksen 
Bolt  Beranek  & Newman 
50  Moulton  Street 
Cambridge,  MA  02138 

DR.  ROBERT  GLASER 
LRDC 

UNIVERSITY  OF  PITTSBURGH 
3939  O'HARA  STREET 
PITTSPURGH,  PA  15213 

DR.  JAMES  G.  GREENO 
LRDC 

UNIVERSITY  OF  PITTSPURGH 
3939  O'HARA  STREET 
PITTsSPURGH,  PA  15213 

Dr.  Richard  S.  Hatch 
Decision  Systems  Assoc.,  Inc. 
350  Fortune  Terrace 
Rockville,  MD  2085** 

Dr.  Barbara  Hayes-Roth 
The  Rand  Corporation 
1700  Main  Street 
Santa  Monica,  CA  90406 

Library 

HumRRO/Western  Division 
27857  Berwick  Drive 
Carmel,  CA  93921 

Dr.  Earl  Hunt 
Dept,  of  Psychology 
University  of  Washington 
Seattle,  WA  98105 

DR.  LAWRENCE  B.  JOHNSON 
LAWRENCE  JOHNSON  & ASSOC.,  INC. 
SUITE  502 
2001  S STREET  NW 
WASHINGTON,  DC  20009 

Dr.  Steven  W.  Keele 
Dept,  of  Psychology 
University  of  Oregon 
Eugene,  OR  9740? 


Non  Govt 


1 LCOL.  C.R.J.  LAFLEUR 
PERSONNEL  APPLIED  RESEARCH 
NATIONAL  DEFENSE  HOS 
101  COLONEL  BY  DRIVE 
OTTAWA,  CANADA  K1A  0K2 

1 Dr.  Frederick  M.  Lord 

Educational  Testing  Service 
Princeton,  NJ  08540 

1 Dr.  Robert  R.  Mackie 

Human  Factors  Research,  Inc. 
6780  Cortona  Drive 
Santa  Barbara  Research  Pk. 
Goleta,  CA  93017 

1 Dr.  Richard  E.  Millward 
Dept,  of  Psychology 
Hunter  Lab. 

Brown  University 
Providence,  RI  82912 

1 Dr.  Donald  A Norman 

Dept,  of  Psychology  C-009 
Univ.  of  California,  San  Diego 
La  Jolla,  CA  92093 

1 Dr.  Melvin  R.  Novick 
Iowa  Testing  Programs 
University  of  Iowa 
Iowa  City,  lA  52242 

1 Dr.  Jesse  Orlensky 

Institute  for  Defense  Analysis 
400  Army  Navy  Drive 
Arlington,  VA  22202 

1 MR.  LUIGI  PETRULLO 

2431  N.  EDGEWOOD  STREET 
ARLINGTON,  VA  22207 

1 DR.  STEVEN  M.  PINE 
N660  ELLIOTT  HALL 
UNIVERSITY  OF  MINNESOTA 
75  E.  RIVER  ROAD 
MINNEAPOLIS,  MN  55455 
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1 DR.  PETER  POLSON 
DEPT.  OF  PSYCHOLOGY 
UNIVERSITY  OF  COLORADO 
BOULDER,  CO  80302 

1 DR.  DIANE  M.  RAMSEY-KLEE 

R-K  RESEARCH  & SYSTEM  DESIGN 
3947  RIDGEMONT  DRIVE 
MALIBU,  CA  90265 

1 MIN.  RET.  M.  RAUCH 
P II  4 

BUNDESMINISTERIUM  DER  VERTEIDIGUNG 
POSTFACH  161 
53  BONN  1,  GERMANY 

1 Dr.  Mark  D.  Reckase 

Educational  Psychology  Dept. 
University  of  Missouri-Columbia 
12  Hill  Hall 
Columbia,  MO  65201 

1 Dr.  Joseph  W.  Rigney 
Univ.  of  So.  California 
Behavioral  Technology  Labs 
3717  South  Hope  Street 
Los  Angeles,  CA  90007 

1 Dr.  Andrew  M.  Rose 

American  Institutes  for  Research 
1055  Thomas  Jefferson  St.  NW 
Washington,  DC  20007 

1 Dr.  Leonard  L.  Rosenbaum,  Chairman 
Department  of  Psychology 
Montgomery  College 
Rockville,  MD  20850 

1 Dr.  Benjamin  Schneider 
Dept,  of  Psychology 
Univ.  of  Maryland 
College  Park,  MD  20742 

1 DR.  WALTER  SCHNEIDER 
DEPT.  OF  PSYCHOLOGY 
UNIVERSITY  OF  ILLINOIS 
CHAMPAIGN,  IL  6 1820 


Non  Govt 


1 Dr.  Lyle  Schoenfeldt 
School  of  Management 
Rensselaer  Polytechnic  Institute] 

Troy,  NY  12181 

1 DR.  ROBERT  J.  SEIDEL 

INSTRUCTIONAL  TECHNOLOGY  GROUP 
HUMRRO 

300  N.  WASHINGTON  ST. 

ALEXANDRIA,  VA  22314 

1 Dr.  Richard  Snow 
School  of  Education 
Stanford  University 
Stanford,  CA  94305 

1 Dr.  Robert  Sternberg 
Dept,  of  Psychology 
Yale  University 
Box  11A,  Yale  Station 
New  Haven,  CT  06520 

1 DR.  ALBERT  STEVENS 

BOLT  EERANEK  & NEWMAN,  INC. 

50  MOULTON  STREET 
CAMBRIDGE,  MA  02138 

1 DR.  PATRICK  SUPPES 

INSTITUTE  FOR  MATHEMATICAL  STUDIES  IN 
THE  SOCIAL  SCIENCES 
STANFORD  UNIVERSITY 
STANFORD,  CA  94305 

1 Dr.  Kikumi  Tatsuoka 

Computer  Based  Education  Research 
Laboratory 

252  Engineering  Research  Laboratory 
University  of  Illinois 
Urbana,  IL  61801 

1 DR.  PERRY  THCRNDYKE 
THE  RAND  CORPORATION 
1700  MAIN  STREET 
SANTA  MONICA,  CA  9Cl»06 

1 Dr.  Benton  J.  Underwood 
Dept,  of  Psychology 
Northwestern  University  \ 

Evanston,  IL  60201  S 
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= 1 DR.  THOMAS  WALLSTEN 

P.SYCHOMETRIC  LABORATORY 
I DAVIE  HALL  01 3A 

I UNIVERSITY  OF  NORTH  CAROLINA 

CHAPEL  HILL,  NC  2751*1 

1 Dr.  John  Wannous 

Department  of  Management 
Michigan  University 
East  Lansing,  MI  «I882U 

[ 1 Dr.  David  J.  Weiss 

' j N660  Elliott  Hall 

[ University  of  Minnesota 

I 75  E.  River  Road 

tj  Minneapolis,  MN  55H55 


Mr.  Isaac  I.  Bajar 
Department  of  Psychology 
Elliott  Hall 
75  East  River  Road 
Minneapolis,  Minnesota  55455 


1 DR.  KEITH  WE.SCOURT 

INSTITUTE  FOR  MATHEMATICAL  STUDIES  IN 
THE  .SOCIAL  .SCIENCES 
STANFORD  UNIVERSITY 

STANFORD,  CA  9*1305  I 

1 Dr.  Anita  West 

Denver  Research  Institute 
University  of  Denver 
Denver,  CO  80201 

1 DR.  SUSAN  E.  WHITELY 
PSYCHOLOGY  DEPARTMENT 
UNIVERSITY  OF  KANSAS 
LAWRENCE,  KANSAS  66049 

1 Scott  E.  Miixwell 

Department  of  Psychology 
University  of  Houston 
Houston,  TX  77004 

1 Dr.  Ron  Hanbleton 
School  of  Education 
university  of  Massachusetts 
Amherst,  Mass.  01002 

1 Dr.  William  E.  Coffman 

Iowa  Testing  Programs  • 

334  Lindquist  Center 
Iowa  City,  lA  52242 


